Deep Light Direction Reconstruction from single RGB images

نویسندگان

چکیده

In augmented reality applications, consistent illumination between virtual and real objects is important for creating an immersive user experience. Consistent can be achieved by appropriate parameterisation of the model, that with real-world lighting conditions. this study, we developed a method to reconstruct general light direction from red-green-blue (RGB) images scenes using modified VGG-16 neural network. We reconstructed as azimuth elevation angles. To avoid inaccurate results caused coordinate uncertainty occurring at steep angles, further introduced stereographically projected coordinates. Unlike recent deep-learning-based approaches reconstructing source direction, our approach does not require depth information thus rely on special red-green-blue- (RGB-D) input.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

21/2 D Scene Reconstruction of Indoor Scenes from Single RGB-D Images

Using the Manhattan world assumption we propose a new method for global 21/2D geometry estimation of indoor environments from single low quality RGB-D images. This method exploits both color and depth information at the same time and allows to obtain a full representation of an indoor scene from only a single shot of the Kinect sensor. The main novelty of our proposal is that it allows estimati...

متن کامل

Training-Based Spectral Reconstruction from a Single RGB Image

This paper focuses on a training-based method to reconstruct a scene’s spectral reflectance from a single RGB image captured by a camera with known spectral response. In particular, we explore a new strategy to use training images to model the mapping between cameraspecific RGB values and scene reflectance spectra. Our method is based on a radial basis function network that leverages RGB white-...

متن کامل

PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Image

This paper proposes a deep neural network (DNN) for piece-wise planar depthmap reconstruction from a single RGB image. While DNNs have brought remarkable progress to single-image depth prediction, piece-wise planar depthmap reconstruction requires a structured geometry representation, and has been a difficult task to master even for DNNs. The proposed end-to-end DNN learns to directly infer a s...

متن کامل

Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud, and it is non-trivial to convert them to the more ready-to-use mesh model. Unlike the existing methods, our network represents 3D mesh in a graph-based conv...

متن کامل

Coupled Lighting Direction and Shape Estimation from Single Images

This paper presents a new method for the simultaneous estimation of lighting direction and shape from shading. The method estimates the shape and the lighting direction using a two step iterative process. We assume an initial (possibly incorrect) estimate of the lighting position. A stiff deformable model is then fitted to the image, assuming this lighting position. Next, a least-squares estima...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computer Science Research Notes

سال: 2021

ISSN: ['2464-4625', '2464-4617']

DOI: https://doi.org/10.24132/csrn.2021.3101.4